The Band-Gap Problem in Semiconductors Revisited: 
Effects of Core States and Many-Body Self-Consistency 
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A novel picture of the quasiparticle (QP) gap in prototype semiconductors Si and Ge emerges 
from an analysis based on all-electron, self-consistent, GW calculations. The deep-core electrons 
are shown to play a key role via the exchange diagram — if this effect is neglected, Si becomes a 
semimetal. Contrary to current lore, the Ge 2)d semicore states (e.g., their polarization) have no 
impact on the GW gap. Self-consistency improves the calculated gaps — a first clear-cut success 
story for the Baym-Kadanoff method in the study of real-materials spectroscopy; it also has a 
significant impact on the QP lifetimes. Our results embody a new paradigm for ab initio QP theory. 



The modern "band-gap problem" originated with the 
realization that density- functional theory (DFT) im- 
plemented in the local-density approximation (LDA), 
failed drastically in the description of the fundamental 
excitation gap of semiconductors and insulators. A sig- 
nificant step forward was achieved in the mid-eighties, 
when the first ab initio calculations of quasiparticle (QP) 
states were performed |^, ^ within Hedin's GW approx- 
imation (GWA) Q. At the present time, it is nearly- 
universally accepted [| |, g |, g 0, |, |, |l§ that the 
GWA yields QP gaps in semiconductors and insulators to 
within 0.1 eV of experiment — which is the level of accu- 
racy required in the study of transport in these materials 

In this Letter we uncover a novel picture of the physical 
ingredients underlying the observed QP gap in Si and Ge. 
Central elements of this picture are the impact of the core 
electrons on the many-body problem for the states at the 
gap, and the role of self-consistency. The GW schemes 
alluded to above turn out to benefit from "cancellation of 
errors" involving the neglect of both effects. Our results 
illustrate the practical importance of the Baym-Kadanoff 
conserving method for the study of excitations in real 
materials. 

These conclusions are arrived at by eliminating ap- 
proximations which are routinely introduced in the im- 
plementation of Hedin's scheme. First, the usual GW 
work invokes the pseudopotential (PS) approximation — 
by which the core states are effectively eliminated from 
the gap problem. However, PS theory does not guaran- 
tee that a "partitioning" of the electrons into two groups 
may lead to an accurate description of the dynamical self- 
energy of the valence states — which, according to DFT, 
is a non-linear functional of the total density. Semicore 
states pose a special challenge ^ ; significantly, on the 
basis of a phenomenological model, the indirect nature 
of the Ge gap has been assigned to an effect of the po- 
larization of the id states ^] . 

Second, in most GW calculations the Dyson equation 
(DEq) is not solved to self-consistency. However, it has 
been shown, for a Hubbard-type model, that this prac- 



tice leads to a genuine violation of charge conservation 
]l2t . Still, from the available self-consistent solutions of 
the DEq 15, 1^ it has been inferred that, while self- 
consistency, at the GW level, is a must in total-energy 
calculations |l^ , the same is "to be avoided" in the study 
of spectroscopy l^j, [ij, |l^, |l^. This state of affairs is 
unsatisfactory, since self-consistency is a necessary con- 
dition for the fulfillment of all the conservation laws |l^ 
— and, thus, for a proper theory of transport Q . 

In our GW calculations all the electrons are taken into 
account in the evaluation of the valence-electron self- 
energy. Remarkably, the deep core states are found to 
play a significant role in the QP gap problem via the 
core- valence exchange diagram. An additional surprise is 
that the (presumably important) shallow Ge 3d semicore 
states have no effect on the GW gap. Self-consistency 
at the GW level does improve the QP gaps; it also im- 
pacts the QP lifetimes. Our results for the Si gap and 
the indirect Ge gap al L agree with experiment very well. 
Other aspects of our calculated QP band structures pro- 
vide signatures of physics beyond the GWA. 

We recall that the exact self-energy is "^-derivable," 
|l9| E [G] (11') = 5^/5G (I'l), where $ is the Luttinger- 
Ward "free-energy" functional; our notation stresses the 
fact that E is a functional of the dressed Green's func- 
tion G. Now, a ^-derivable E, obtained on the ba- 
sis of an approximate ^-functional, coupled with a self- 
consistent solution of the DEq, G'^ (1, 1') = Gg ^ (1, 1')- 
(E [G] (1, 1') - (a* - Mo) 5{l- I'SVensmes that G fulfills 
the conservation laws exactly |1^. [Here 1,1' denote 
space-time points; Matsubara times t are defined for 
< T < (31%. fi, the chemical potential for the correlated 
system with a fixed number of electrons, is obtained self- 
consistently with G; /i differs appreciably (~leV) 
from its counterpart fiQ for the reference one-electron 
system whose Green's function is Gq.] The GWA [Q is 
defined by the ^-functional 
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where the particle-hole bubbles are made up of G's 
(not Go's), and the dashes represent the Coulomb in- 
teraction V. Functional differentiation of ^aw yields 
T,Gw [G] = [G] + 'Sxc [G], where [G] is the Hartree 
term, and the exchange-correlation (XC) term is of 
the Hedin form [G] (1, 1') = -G (1, 1') W [G] (1, 1'), 
where [G] (1, 1') is the screened interaction Q. 

We work in the basis of the Kohn-Sham (KS) 
states (/)k,j (x) provided by the full-potential, linearized 
augmented-plane-wave (FLAPW) method here k is 
a wave vector in the Brillouin zone, and j is a band index. 
Adopting (without lack of generality) the KS system as 
the reference one-particle system, described within the 
LDA, the DEq can be written as |Q 

G,,, (r - r') = G^^^-4 (r - r') + G^,^^ (r - n) 
X [Sfc,, (fi - f2) - {Vf^f^ + (^-^,))S (fi - f2)] 

xGfe,,(f2-T'), (2) 

where G^^^^ (t) = -^e-""-^^/^ {9 (t) - np (ek^j)), the 
KS eigenvalues Skj being measured from ^q, V^^^ is 
the KS potential without the nuclear contribution, and 
summation over variables with a bar on top is under- 
stood. 

We solve Eq. (||) and the integral equation for 
W [G] (1, 1') (in the latter case, in reciprocal space) on 
the T-axis. Our approach is ideally suited for a self- 
consistent evaluation of G and should prove valuable in 
calculations beyond the GWA ||2^ . A novel feature of our 
scheme — which is devoid of the cutoff effects encountered 
in cj-axis formulations p6| — is the use of a non- uniform 
"power mesh" (PM) ]2C| ] which, as outlined in Fig. |^, 
accounts for the nature of both G and the particle-hole 
bubble — which are strongly peaked at the ends of the 
interval < r < (31%, being flat in between; moreover, the 
PM allows us to perform high-order interpolation (scaling 
'^linearly) to generate all functions on the dense, uniform 
mesh required in the evaluation of the products enter- 
ing the T-integrals |Q . From the solution of Eq. (||) we 
evaluate the spectral function A^j (w) = — ^ImG^,, (cj) 
via analytic continuation of G onto the real-w axis [ p3| . 
For the j-bands of interest, A^^j (w) shows a well-defined 
peak, whose k — uj dependence yields the QP band struc- 
ture — see Fig. ||. 

The convergence of our results was tested by vary- 
ing the parameters involved in: fc-space sampling (we 
used 5x5x5 and 8x8x8 meshes), number of bands (14 and 
24), number of (reciprocal lattice-) if -vectors used in the 
evaluation of Ea;c (9, 27, 51, and 65), temperature (4000, 
2000, 1000, and 300 K), and PM mesh (p5u20, p6ul0, 
and p6u20). The most demanding parameter, the num- 
ber of if-vectors kept in the valence exchange term, is 
associated with a monotonic opening of the Si gap. (The 
core contribution converges even slower; thus, a 6D real- 
space integral is evaluated instead.) In the case of Si we 
estimate that the absolute gap is converged to ~0.1 eV 
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FIG. 1; a): The PM used to solve the DEq on the r-axis 
is defined by two integers: "p" is the "order" of the under- 
lying non-uniform mesh, whose width doubles in each step; 
"u" is the number of uniform intervals into which the non- 
uniform intervals are partitioned, b): Typical r-dependence 
of G and of the particle- hole bubble (GG); their exponential 
localization (and discontin uity ^ at r = and /3h is efficiently 
accounted for by our PM |20|. c): Spectral function Akj (to) 
for Si along PL; to aid visualization, small numerical broaden- 
ing has been introduced, d): Akj (a;) for the hole state at the 
midpoint of the occupied band; the solid/dashed line denotes 
the self-consistent /first-iteration solution of Eq. (0). 



from below; for Ge the convergence is even better, from 
both directions. 

Table ^ provides the framework for a discussion of our 
results for the absolute QP gap (located at ^80% FX), 
the direct gap at F, and the occupied bandwidth of Si. 
Our results comprise two levels of implementations of 
the GWA: (i) A self-consistent solution of Eq. (|^), corre- 
sponding to the evaluation of the self-energy Y,gw [Gqw] 
(3'"'' row); this calculation represents a numerical re- 
alization of a conserving approximation ]ll[ |. (ii) A 
non-conserving calculation (4*'' row) corresponding to 
the use of the self-energy T,gw [Glda] — the standard 
"Glda Wlda approximation |, |[ |, 1 1, |, |, |, 0- 
Clearly, the gaps obtained from T,gw [Ggw] are in good 
agreement with experiment [Q; the mechanisms behind 
this agreement turn out to be quite unexpected — and 
instructive. 

Indeed, on the basis of several numerical tests, we un- 
covered, first of all, the role of the deep-core electrons. 
In one set of calculations we suppressed their contribu- 
tion to the exchange self-energy — 2"'^ term in Eq. (|^) — 
for the states at the gap At the ^gw [Glda] level, 
the absolute gap (~0.85 eV, see Table ^ is then reduced 
by 0.9 eV — i.e., the gap is closed, the ensuing QP band 
structure of Si corresponding to a semi-metal. While the 
size of this effect is surprising, its physics is easy to visu- 
alize: (j)The core electrons shield the attractive field of 
the nuclei (via the 1** term in Eq. (|l|), thereby raising the 
energy of the valence and conduction states; (ii) the ex- 
change process partially compensates for this effect; (Hi) 
the states across the gap have different amplitudes in the 
core region; these amplitudes control the strength of the 
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TABLE I: QP band gaps and occupied bandwidth of Si. 
Comparison of our all-electron GW results with experiment, 
with the (approximate) all-electron GW calculations of Refs. 

and and with a representative PS-based GW cal- 

culation. The y'' row obtains from our fully conserving self- 
energy T,Gw [Ggw\ \ the 4"* row, and all rows below it, obtain 
from the non-conserving approximation Y^gw [Glda]- 
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1.17 


3.40 


12.5 ± 0.6 


LDA (FLAPW) 


0.52 


2.53 


12.22 






1.03 


3.48 


13.53 


Sgw [Glda] 




0.85 


3.12 


12.15 


^all-electron 
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1.01 


3.30 


12.21 


^all-electron 




1.00 


3.15 




PS-based § 




1.29 


3.35 


12.04 



exchange. It is the larger lowering of the energy of the 
QP states below the gap, relative to those above it, due 
to the non-local core-valence exchange process, that leads 
to this novel all-electron effect . 

Further insight into the role of the core electrons is 
obtained by simulating their contribution to T^^c [Glda\ 

as Ef™"^ core ^ yLDA _ yLDA ^^^^^ ^^^^ 

and Uyai are the total and valence densities, and V^J^^ 
is the XC contribution to V^^^. This uncontrolled 
"LDA recipe" yields a spurious 0.15 eV additional open- 
ing of the Si gap The significance of this test is 
that it accounts (Table ^ for the difference between the 
approximate FLAPW-based Sgw [GLDA]-^eve\ result of 
Hamada, Hwang, and Freeman |^ (1.01 eV) and our own 
(0.85 eV) — Ref. ||^ relies on this LDA ansatz for the 
core contribution to the valence-electron self-energy, as 
the PS-based GW schemes implicitly do. 

From Table ^ we draw a second key message: contrary 
to current wisdom Q ^ ^ ^ |l8|, self-consistency 
does improve the quality of the calculated GW gaps of 
Si; cf. rows 1, 3, and 4. Indeed, the additional open- 
ing of the gaps obtained from Sgiv [Gqw] brings them 
closer to their experimental values. This effect is traced 
to the dressing of both W and G. Indeed, the dynam- 
ical screening built into W , which greatly reduces the 
exaggerated Hartree-Fock (HF) gap, is weakened for the 
dressed W] the dressing of G widens the gap as well, 
a trend most easily visualized within self-consistent HF 
. We stress that the success of our conserving scheme 
is intimately related to the fact that we have carried out 
a full all-electron calculation [ p7| . 

Interestingly, self-consistency also has a significant ef- 
fect on the QP lifetimes, given by the inverse of the 
full-width at half-maximum (FWHM) of the QP peak 
in Aj: ■ (w). As seen in Fig. |^d) for the hole state at 
the midpoint of the Si band, the FWHM (solid line) is 



significantly reduced, relative to its non-self-consistent 
counterpart (dashes). This effect — which has been 
ignored in the rapidly-growing literature on "hot car- 
rier" lifetimes — recognizes two sources. First, fully 
dressed QP's scatter less frequently off the Fermi sea than 
in the T,gw [Glda\ case. Second, in the latter, non- 
self-consistent case, the gap edges recognized by Glda 
and ImT^GW [Glda] are different. This mismatch in 
the gap edge, A, exaggerates the FWHM according to 
(e -I- A)^ - = 2A • e -I- A^, where e is the QP energy 
measured from each gap edge, and A '^[(/i — /iq) plus the 
shift of the respective edge relative to LDA] ||2^. (N.B.: 
the QP states obtained from Sgvk [Glda] have an un- 
physical finite lifetime, ^ A^, at the gap edges!) 

From Table | it also follows that PS-based GW 
schemes carry a built-in error which is comparable with 
the LDA gap — cf. the representative PS-based result 
(1.29 eV 7*'' row) with our corresponding all-electron 
result (0.85 eV; 4*'' row). In addition to the non-local 
many-body effect of the core elucidated above, there is 
the impact on the matrix elements of Sgvk of the removal 
of the oscillations of the valence wave functions at the 
atomic sites ||2^. Interestingly, the projector-augmented- 
wave result of Arnaud and Alouani ||l^ (6*'* row) provides 
an independent measure of the error due to the latter 
source. We stress that, at the Egw [Glda] level, the un- 
controlled PS approximation ||, ^, |[ ||, ^, |^, ^ is masked 
by the neglect of self-consistency — which introduces an 
opposite-sign error, and results in apparent agreement 
with the experimental gap p7| . 

Ge is isoelectronic with Si, and has the same diamond 
crystal structure. It is then reassuring that an analy- 
sis along the above lines confirms that our conclusions 
concerning the impact of the deep core states and many- 
body self-consistency apply in the case of Gc as well. 
Note, in particular, the column of Table |l|: The ad- 
ditional opening of the indirect gap at L obtained from 
'^GW [Ggw] (3'^'' row) — relative to the value obtained 



TABLE II: QP band gap and occupied bandwidth of Ge. In 
the 5*'* row we exclude the contribution from the 3d states 
to the valence-state self-energy. For other conventions, see 
Table § for the 6*'' row, see text. 
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FIG. 2: Solid lines: Real and imaginary parts of the density- 
response function of Ge, obtained in an adiabatic, local, 
implementation of time-dependent density-functional theory 
[P3[ . The dashes correspond to the elimination of transitions 
from the 3d states. The 3d-onset is highlighted in the inset. 



from Tjgw [Glda\] 4*'' row — leads to excellent agree- 
ment with experiment |2^ . 

A significant issue in Ge is the role of the 2>d semicore 
states (which lie ~25eV below the gap). In fact, in the 
standard PS-based GW approach, the correct topology 
of the QP band structure along PL — which is automati- 
cally produced in our results — is obtained only upon in- 
troducing the 3(i's in the gap problem via a phenomeno- 
logical core-polarization potential (CPP) model 1^. Our 
all-electron approach places us in a position to address 
this issue. Shown in Fig. |^ is the density-response func- 
tion 1^ of Gc for a small wave vector, evaluated with 
and without the contribution from the Sd's. Evidently, 
the screening is virtually identical in both calculations 
for energies up to ~10 eV, by virtue of the weak transi- 
tion strength of the Sd's. Thus, the impact of the CPP 
model 1^ is not physically justified. Moreover, if the Sd's 
are excluded from both W and G, our all-electron QP 
band structure remains unchanged (5*'* row). We con- 
clude that the 3d's play no role within the GWA. 

Now, although our calculated indirect gap at L agrees 
with experiment very well, other aspects of our GW re- 
sults for Ge are less satisfactory. As illustrated in Table || 
(3'"'' column), the empty states near X lie slightly below 
the lowest empty state at L — contrary to experiment 
p^ . This ordering, which is reversed in the absence of 
screening — i.e., if S is evaluated within HP |^ — pro- 
vides a signature of the limitations of the GWA (note also 
our results for the Ge direct gap and the Si and Ge band- 
widths). Thus, we expect that the localized Ge states 
may induce short-range correlation effects in E; within 
the conserving method, such effects are to be included 
by adding an appropriate ^-functional to Eq. (^ p9| . 

In summary, our results embody a new paradigm for ah 
initio QP theory, as we have demonstrated the non-trivial 
role played by the deep core states, and many-body self- 
consistency, in the QP gap problem; self-consistency — 
and thus, the fulfillment of the conservation laws — was 
also shown to impact the QP lifetimes. These effects, 



whose inclusion leads to excellent agreement with exper- 
iment for the Si absolute gap, and for the Ge indirect 
gap al L, are masked in the standard GW schemes. The 
Ge 3(i semicore states were found to play no role in the 
GW gap; their impact is likely to come via effects be- 
yond the GWA. Our results indicate that a fundamental 
description of the entire valence QP band structure of Si 
and Ge within O.leV requires the inclusion of mechanisms 
beyond the GWA. 
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